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Amendments "to the Claims 

This listing of claims will replace all prior 
versions, and listings, of claims in the application: 
Listing of Claims: 

1. (Currently Amended) A method for assessing 
adequacy of a message-flow test suite for testing a message 
flow tooting through a set of message flow elements , the 
method comprising: 

defining coverage criteria providing numerical 
evaluations of an extent to which the message-flow test suite 
covers a predefined property for tooting a mcooagc — f lovj 
through q — oot of mcooagc — flow clcmonto ; 

determining a numerical message-flow-coverage-goal 
for the message flow with respect to the coverage criteria; 
dcoigning a tcot — ouitc rooponoivc to tho mcooagc — f lov^y - 
covcragc — goal ; 

applying the message-flow test suite to the message 
flow , while evaluating the coverage criteria so as to generate 
a numerical coverage result for the set of message flow 
elements; and 

comparing the numerical coverage result with the 
numerical messaqe-f low-coveraqe-goal , so as to evaluate the 
adequacy of the message-flow test suite . 
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2. (Original) A method according to claim 1, 
wherein the message flow comprises a message-oriented software 
program wherein a message is a primary architectural element. 

3. (Original) A method according to claim 1, 
wherein the message flow is comprised in a message-oriented 
middleware application . 

4. (Original) A method according to claim 1, 
wherein the message flow comprises a visual program describing 
processing logic as a directed graph and wherein the message 
flow comprises an independent function, outside of a message 
sender or message receiver. 

5. (Original) A method according to claim 1, 
wherein the message flow comprises a program processing a 
message produced by an application chosen from one of a group 
of applications comprising a client application and a server 
application . 

6. (Original) A method according to claim 5, 
wherein the application comprises a message-sending- 
application and a message-receiving-application executing on 
different hardware platforms. 

7. (Original) A method according to claim 6, 
wherein the message-sending-application and the message- 
receiving-application are implemented using different software 
and architectural paradigms. 
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8. (Original) A method according to claim 1, 
wherein the message flow elements comprise at least one 
element chosen from messages, nodes, connections, terminals, 
statements, conditions, external resources, and exceptions. 

9. (Original) A method according to claim 1, 
wherein defining the coverage criteria comprises selecting a 
coverage model from at least one of processing node coverage, 
terminal coverage, connection coverage, path coverage, N-node 
coverage, statement coverage, multiple condition coverage, 
exception coverage, external resources coverage, and message 
content coverage. 

10. (Currently Amended) A method according to claim 
1, wherein determining the numerical message-flow-coverage- 
goal comprises establishing a required coverage level for at 
least one of the coverage criteria. 

11. (Currently Amended) A method according to claim 

I, wherein applying the message-flow test suite to the message 
flow comprises: 

performing an execution of at least a part of the 
message-flow test suite; and 

evaluating an attained coverage level resulting from 
the execution. 

12. (Currently Amended) A method according to claim 

II, wherein evaluating the attained coverage level comprises: 
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visiting one or more nodes during the execution of 
the at least part of the message-flow test suite; 

comparing a number of processing nodes visited to a 
total number of all processing nodes in the message flow; and 

computing a processing node coverage metric 
responsive to the comparison. 

13. (Original) A method according to claim 12, 
wherein visiting the one or more nodes comprises entering a 
simple node. 

14. (Original) A method according to claim 12, 
wherein visiting the one or more nodes comprises entering a 
compound node and visiting zero or more nodes in a constituent 
sub-flow . 

15. (Currently Amended) A method according to claim 
11, wherein evaluating the attained coverage level comprises: 

traversing one or more terminals during the 
execution of the at least part of the message-flow test suite; 

comparing a number of processing node terminals 
traversed to a total number of processing node terminals in 
the message flow; and 

computing a terminal coverage metric responsive to 
the comparison. 

16. (Currently Amended) A method according to claim 
11, wherein evaluating the attained coverage level comprises: 
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traversing one or more connections during the 

execution of the at least part of the message- flow test suites- 
comparing a number of connections traversed to a 

total number of connections in the message flow; and 

computing a connection coverage metric responsive to 

the comparison. 

17. (Original) A method according to claim 11, 

wherein evaluating the attained coverage level comprises: 
selecting a group of one or more sets of N-nodes 

from the message flow, wherein N comprises any whole number 

less than or egual to a total number of nodes in the message 

f low; 

performing at least one execution of the message 
flow so as to determine a number of nodes visited in each of 
the one or more sets during the at least one execution; 

generating a respective set coverage result for each 
of the one or more sets, responsive to the number of nodes 
visited; 

determining a number of covered-sets, responsive to 
the set coverage results; 

comparing the number of covered-sets to a total 
number of sets in the group; and 

computing an N-node coverage metric responsive to 
the comparison. 



- 6 - 



Appln. No. 10/091,416 

Amd dated: April 17, 2006 

Reply to Office Action of March 17, 2006 

18. (Currently Amended) A method according to claim 
11, wherein evaluating the attained coverage level comprises: 

performing zero or more runtime exceptions during 
the execution of the at least part of the message- flow test 
suite; 

comparing a number of runtime exceptions performed 
to a total number of all runtime exceptions in the message 
flow; and 

computing an exception coverage metric responsive to 
the comparison. 

19. (Currently Amended) A method according to claim 
11, wherein evaluating the attained coverage level comprises: ■ 

visiting zero or more failure terminals during the 
execution of the at least part of the message-flow test suite; 

comparing a number of failure terminals visited to a 
total number of all failure terminals in the message flow; and 

computing an exception coverage metric responsive to 
the comparison. 

20. (Currently Amended) A method according to claim 
11, wherein evaluating the attained coverage level comprises: 

executing zero or more node statements at least once 
during the execution of the at least part of the message-flow 
test suite; 
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comparing a number of node statements executed to a 
total number of node statements in the message flow; and 

computing a statement coverage metric responsive to 
the comparison. 

21. (Original) A method according to claim 20, 
wherein computing the statement coverage metric comprises 
comparing a number of node statements executed in a single 
node to a total number of node statements in the single node. 

22. (Original) A method according to claim 20, 
wherein computing the statement coverage metric comprises 
comparing a number of node statements executed in a compound 
node's constituent sub-flows to a total number of node 
statements in the compound node's constituent sub-flows. 

23. (Currently Amended) A method according to claim 
11, wherein evaluating the attained coverage level comprises: 

assessing an achievement of true and false values 
for each of zero or more boolean sub-expressions independently 
during the execution of the at least part of the mess age -flow 
test suite; 

comparing the achievement for the one or more 
boolean sub-expressions to a total number of boolean sub- 
expression values possible in the message flow; and 

computing a multiple condition coverage metric 
responsive to the comparison. 
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24. (Original) A method according to claim 23, 
wherein computing the multiple condition coverage metric 
comprises comparing a number of achieved true and false values 
for zero or more boolean sub-expressions in a node to a total 
number of boolean sub-expression values possible in the node. 

25. (Original) A method according to claim 23, 
wherein computing the multiple condition coverage metric 
comprises comparing a number of achieved true and false values 
for zero or more boolean sub-expressions in a compound node's 
constituent sub-flows to a total number of boolean sub- 
expression values possible in the compound node's constituent 
sub-flows . 

26. (Currently Amended) A method according to claim 
11, wherein evaluating the attained coverage level comprises: 

assessing a number of values assumed by each of one 
or more fields in a message during the execution of the at 
least part of the mess age- flow test suite; 

comparing the number of values assumed to a total 
number of possible values for each field in the message; and 

computing a message content coverage metric 
responsive to the comparison. 

27. (Original) A method according to claim 26, and 
comprising computing a strong message content coverage metric 
wherein the total number of values possible for each field in 
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the message comprises a cross product of the message fields 
with their possible values. 

28. (Original) A method according to claim 26, and 
comprising computing a weak message content coverage metric 
wherein the total number of values possible for each field in 
the message comprises a sum of the number of possible values 
for each message field independently. 

29. (Currently Amended) A method according to claim 
11, wherein evaluating the attained coverage level comprises: 

traversing one or more paths during the execution of 
the at least part of the message -flow test suite; 

comparing a number of paths traversed to a total 
number of paths in the message flow; and 

computing a path coverage metric responsive to the 
comparison . 

30. (Currently Amended) A method according to claim 
11, wherein evaluating the attained coverage level comprises: 

performing zero or more types of accesses to an 
external resource during the execution of the at least part of 
the message-flow test suite; 

comparing a number of types of accesses performed to 
a total number of types of accesses in the message flow; and 

computing et an external resources coverage metric 
responsive to the comparison. 
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31. (Currently Amended) A method according to claim 
1, wherein and comprising designing the message-flow test 
suite responsive to the message-flow-coverage-goal comprioco 
using the steps of : 

identifying an initial message-flow test suite for 
the message flow; 

assessing a coverage level achieved by the initial 
message-flow test suite; and 

adding additional tests to the initial message-flow 
test suite so as to increase the coverage level. 

32- (Currently Amended) A method according to claim 
1, wherein applying the message- flow test suite comprises 
generating message-flow-coverage-reports . 

33. (Original) A method according to claim 29, and 
comprising integrating the message-flow-coverage-reports into 
a visual message flow development environment. 

34. (Original) A method according to claim 1, and 
comprising reporting coverage graphically using at least one 
graphical element chosen from a set of color, shading, 
highlighting, graphing, fonts, line styles, icons, and labels. 

35. (Original) A method according to claim 1, and 
comprising reporting coverage via at least one medium chosen 
from hard-copy media and electronic media. 
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36. (Currently Amended) A method according to claim 
1, wherein generating the numerical coverage result comprises 
collecting coverage data using at least one method of data 
collection chosen from message flow instrumentation and data 
logging . 

37. (Currently Amended) Apparatus for assessing 
adequacy of a message-flow test suite for testing a message 
flow testing through a set of message flow elements ^ the 
apparatus comprising a computer system which is adapted to 
define coverage criteria providing numerical evaluations of an 
extent to which the message-flow test suite covers a 
predefined property for tooting a mcoGago flovj through a oot 
of mcooagc — flovj clcmGntO ;. determine a numerical message-flow- 
coverage-goal for the message flow with respect to the 
coverage criteria, dooign a tcot ouitc rQoponoivQ to the 

me ooago - flovj - coverage - goal , apply the message-flow test suite 
to the message flow ^ while evaluating the coverage criteria so 
as to generate a numerical coverage result for the set of 
message flow elements, and compare the numerical coverage 
result with the numerical message-flow-coverage-goal , so as to 
evaluate the adequacy of the message-flow test suite . 

38. (Currently Amended) A computer software product 
for assessing adequacy of a message-flow test suite for 
testing a message flow tooting through a set of message flow 
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elements ^ comprising a computer-readable medium having 
computer program instructions recorded therein, which 
instructions, when read by a computer, cause the computer to 
define coverage criteria providing numerical evaluations of an 
extent to which the message-flow test suite covers a 
predefined property for — tcQting — a mcGQagQ — flow through q — act 
of mcDoago flov^r clomQnto , determine a numerical message-f low- 
coverage-goal for the message flow with respect to the 
coverage criteria, design a tcot — suite — rcoponDivc — to the 
moooagG — flow - cove rage — goal, apply the message-f low test suite 
to the message flow , while evaluating the coverage criteria so 
as to generate a numerical coverage result for the set of 
message flow elements, and compare the numerical coverage 
result with the numerical message-flow-coverage-goal , so as to 
evaluate the adequacy of the message-flow test suite . 
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